Spatiotemporal Derivative Pattern: A Dynamic Texture Descriptor for Video Matching

We present Spatiotemporal Derivative Pattern (SDP), a descriptor for dynamic textures. Using local continuous circular and spiral neighborhoods within video segments, SDP encodes the derivatives of the directional spatiotemporal patterns into a binary code. The main strength of SDP is that it uses fewer frames per segment to extract more distinctive features for efficient representation and accurate classification of the dynamic textures. The proposed SDP is tested on the Honda/UCSD and the YouTube face databases for video based face recognition and on the Dynamic Texture database for dynamic texture classification. Comparisons with existing state-of-the-art methods show that the proposed SDP achieves the overall best performance on all three databases. To the best of our knowledge, our algorithm achieves the highest results reported to date on the challenging YouTube face database.